Image processing method and image processing computer program

ABSTRACT

Information indicating an area of an image and information indicating attributes of the image have been stored in an IC chip attached to an original paper. When a copying apparatus performs a character recognition process operation with respect to an image displayed on the original paper, the copying apparatus reads the information related to the area of the image and the information related to the attribute of this area from the IC chip attached to this original paper. Then the copying apparatus separates an area where a character is displayed therefrom. The copying apparatus executes the character recognition process operation with respect to the image of the separated area.

INCORPORATION BY REFERENCE

This application is a division of U.S. application Ser. No. 10/647,301,filed Aug. 26, 2003 now U.S. Pat. No. 7,356,205, which claims prioritybenefit to Japanese Patent Application No. 2002-248787 filed on Aug. 28,2002, which is incorporated herein by reference in its entirety.

BACKGROUND

1. Field of the Invention

The present invention relates to an image processing system and an imageprocessing method, which can support an image processing operation byusing a non-contact memory attached to an original document.

2. Description of the Related Art

A compact semiconductor chip (for example, μ-chip by HITACHI, LTD.) fromwhich an external unit can read stored data in a non-contact manner hasbeen known.

Also, JP-A-2001-229199, JP-A-2000-285203, JP-A-2001-134672,JP-A-2001-283011, JP-A-2001-148000, and JP-A-2001-260580 discloseapplications of the compact semiconductor chip.

SUMMARY

The present invention has been made from the viewpoint of theabove-explained technical background, and therefore, has an object toprovide an image processing system and an image processing method, whichcan perform processing operations, which are adapted to a text imagecontained in an image and a picture image, respectively, while utilizinga semiconductor chip from which data stored therein can be read in anon-contact manner.

Next, a description will now be given on an image processing systemaccording to the invention.

It should be understood that the invention is not limited to thefollowing description.

In an image processing system according to the invention, for instance,one or more sorts of images (characters, bar codes, hand-writtencharacters, drawings, pictures etc.) are displayed on a paper document(namely, image display member), the image of which is to be read.

A data supply device contained in the paper original corresponds to, forexample, a semiconductor chip from which data stored thereinto can beread by using electromagnetic waves.

The semiconductor chip is attached to the paper original in an embeddingmanner, or the like. In a first image processing system according to theinvention, a position and an area (area data) with respect to each ofsorts of images displayed on the paper original are recorded inassociation with attributes (attribute data) of the sorts.

In this case, the attributes may include an attribute (for example,character, numeral, symbol, which are printed out by predetermined font)of a text, an attribute (for instance, drawing and photograph) of apicture, an attribute (portion where image is not displayed) of a blank,and so on.

In other words, one or more sorts of images are displayed on the paperoriginal, e.g., a text image (namely, image of character) having anattribute of a text, and a picture image (namely, image of drawing, andimage of photograph) having an attribute of a picture.

Also, in second and third image processing systems according to theinvention, the semiconductor chip may store thereinto data (contentsdata) such as texts and pictures, which constitute an image to bedisplayed.

An image processing apparatus is, for instance, a copying machine, whichreads an image from the paper original by way of a scanner (image readunit), performing a predetermined image process operation with respectto the read image, and printing the processed image.

A data read unit reads the area data and the like from the semiconductorchip via an antenna, which is arranged in the vicinity of the paperdocument by employing electromagnetic waves.

An image process unit separates either a text image or a picture imagebased upon the area data, and then, executes an image processingoperation with respect to the separated text image or the separatedpicture image in accordance with the attribute thereof.

For instance, the image process unit performs a character recognitionprocess operation in which an OCR process operation is performed withrespect to the text image to recognize a character, which constitutesthe text image.

Alternatively, the image process unit performs an image correctingprocess operation with respect to the picture image, in whichreproducibility of half tone gradation may be given a priority.

It should also be understood that the image process unit may carry out aprocess operation in correspondence with an attribute of an image (forexample, blank portion within image) from which both the text image andthe picture image have been separated.

Also, a correspondence judging unit employed in the second imageprocessing system judges as to whether or not the text data (contentsdata) read from the semiconductor chip corresponds to the image read bythe scanner.

For example, the correspondence judgment unit recognizes a character,which constitutes the image read by the scanner based upon this imageread by the scanner, and then, compares this recognized character withthe text data read from the semiconductor chip in order to judge whetheror not this recognized character corresponds to the text data.

When the recognized character does not correspond to the text data, theimage process unit executes the image processing operation by giving thetext data read from the semiconductor chip a top priority.

Also, a contents data production unit employed in the third imageprocessing system recognizes, for example, a text and a picture from theimage read by the scanner, and then, extracts them as contents data.

Specifically, the contents data production unit produces the text databy performing, for example, an OCR process operation with respect to animage.

It should also be noted that when the contents data is not read from thesemiconductor chip, the contents data production unit produces thecontents data, whereas in other cases, the contents data production unitneed not produce the contents data.

Image Display Member/Image Processing Apparatus

An image display member and an image processing apparatus according tothe present invention correspond to the image display member and theimage process apparatus, which are employed in any one of the first tothird image processing systems.

Image Processing Method

Also, a first image process method uses an image display member on whichat least one sort of image is displayed. The first image process methodincludes supplying to an external, area data indicating an area of animage display member in which the at least one sort of image isdisplayed and attribute data indicating attributes of the at least onesort of image, reading the displayed image, reading the supplied areadata and the supplied attribute data, separating the at least one sortof image from the read image on the basis of the read area data, andperforming an image processing with respect to the separated at leastone sort of image in response to the attributes of the at least one sortof image on the basis of the read attribute data.

A second image process method uses an image display member on which animage is displayed. The second image process method includes supplyingto an external, content data indicating at least a part of the displayedimage, reading the displayed image, reading the supplied content data,judging whether the read image and the read content data correspond toeach other, and when the correspondence judgment unit judges that thereis a portion of the image display member where the read image and theread content data does not correspond to each other, selecting one ofthe image read from the portion and the content data corresponding tothe portion.

A third image process method uses an image display member on which animage is displayed. The third image process method includes supplyingcontent data indicating the image to an external, reading the displayedimage, reading the supplied content data, and producing the content datafrom the read image in a case other than that the content data has beenread.

A first program makes a computer of an image process apparatus executethe following process. The process includes reading an image displayedon an image display member, reading area data indicating an area inwhich at least one sort of image is displayed and attribute dataindicating an attribute of the at least one of the image, separating theat least one sort of image from the read image on the basis of the readarea data, and performing an image processing with respect to theseparated at least one sort of image in response to the attribute of theat least one sort of image on the basis of the read attribute data.

A second program makes a computer of an image process apparatus executethe following process. The process includes reading an image displayedon an image display member, reading content data indicating at least apart of the displayed image from the image display member, judgingwhether the read image and the read content data correspond to eachother, and when it is judged that there is a portion of the imagedisplay member where the read image and the read content data does notcorrespond to each other, selecting one of the image read from theportion and the content data corresponding to the portion.

A third program makes a computer of an image process apparatus executethe following process. The process includes reading an image displayedon an image display member, reading content data indicating the imagefrom the image display member, and producing the content data from theread image in a case other than that the content data has been read.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram for indicating a hardware structure of a copyingapparatus to which an image processing method of the present inventionis applied, i.e., for mainly exemplifying a control apparatus thereof.

FIG. 2 is a diagram for exemplifying a hardware construction of acopying apparatus main body indicated in FIG. 1.

FIG. 3 is a diagram for exemplifying an original paper shown in FIG. 1and FIG. 2.

FIG. 4 is a diagram for exemplifying information which is stored into afirst IC chip attached to the original paper shown in FIG. 3.

FIG. 5 is a diagram for showing a structure of the first IC chipindicated in FIG. 3.

FIG. 6 is a diagram for indicating a structure of an IC chip IF shown inFIG. 1 and FIG. 2.

FIG. 7 is a diagram for showing a structure of a first image processingprogram which is executed by the control apparatus 2 (FIG. 1 and FIG. 2)so as to realize the image processing method according to the presentinvention.

FIG. 8 is a flow chart for indicating a first operation (step S10) ofthe copying apparatus (first image processing program).

FIG. 9 is a diagram for representing a structure of a second imageprocessing program.

FIG. 10 is a flow chart for indicating a second operation (step S12) ofa copying apparatus (second image processing program).

FIG. 11 is a diagram for showing a modified example of data which isstored in the IC chip.

FIG. 12 is a diagram for indicating a structure of a third imageprocessing program.

FIG. 13 is a flow chart for describing a third operation (S14) of acopying apparatus (third image processing program).

FIG. 14 is a diagram for indicating a structure of a fourth imageprocessing program.

FIG. 15 is a flow chart for describing a fourth operation (S16) of acopying apparatus (fourth image processing program).

DETAILED DESCRIPTION OF EMBODIMENTS First Embodiment

Now, a description will be made on a first embodiment of the invention.

Copying Apparatus

FIG. 1 is a diagram for showing a hardware structure of a copyingapparatus 1 to which an image processing method according to theinvention is applied, while mainly showing a control apparatus 2thereof.

As shown in FIG. 1, the copying apparatus 1 includes the controlapparatus 2 and a copying apparatus main body 10.

The control apparatus 2 includes a control apparatus main body 20, acommunication apparatus 22, a recording apparatus 24 such as an HDD/CDapparatus, a user interface apparatus (UI apparatus) 26, and an IC chipinterface (IC chip IF) 28. The control apparatus main body 20 contains aCPU 202, a memory 204, and the like. The user interface apparatus 26contains either an LCD display apparatus or a CRT display apparatus, anda keyboard/touch panel, and so on. The IC chip interface 28 contains anantenna 280.

Copying Apparatus Main Body 10

FIG. 2 is a diagram for showing an example of a hardware structure ofthe copying apparatus main body 10 indicated in FIG. 1.

As shown in FIG. 2, the copying apparatus main body 10 includes a papertray unit 12, a print engine 14, a scanner 16, an original feedingapparatus 18, and the like. The print engine 14 prints an image on aprinting paper 42 by way of the xerography technique and the like. Thescanner 16 reads an image of the original paper 40. The original feedingapparatus 18 feeds the original paper 40.

Also, in the copying apparatus main body 10, both the IC chip IF 28 andthe antenna 280 are arranged in the vicinity of an original feeding paththrough which the original paper 40 is fed by the original feedingapparatus 18. Also, the UI (user interface) apparatus 26 is arranged atan upper portion of the first copying apparatus main body 10.

In other words, the copying apparatus 1 may be realized by employingsuch a hardware structure that both the IC chip IF 28 and the antenna280 are additionally provided in a general-purpose copying apparatus forreading an image of the original paper 40 fed from the original feedingapparatus 18 and performing an image processing operation to this imageto print the processed image.

It should be noted that as shown in FIG. 2, the control apparatus 2 (seeFIG. 1) is actually stored inside the copying apparatus main body 10.

Original Paper 40

FIG. 3 is a diagram for showing an example of the original paper 40shown in FIG. 1 and FIG. 2. As shown in FIG. 3, an IC chip 3 is attachedto the original paper 40 in an embedding method, or the like.

A text area 410 and an image area 420 are provided on a surface of theoriginal paper 40. The text area 410 is an area on which one or moreimage is displayed, for example, a text image printed with apreliminarily designated font is displayed. On the image area 420, apicture image such as a photograph and a handwritten character isdisplayed.

FIG. 4 is a diagram for showing an example of information, which isstored in the IC chip 3 attached to the original paper 40 shown in FIG.3.

As shown in FIG. 4, area data indicating the area where the text imageis displayed or the area where the picture image is displayed are storedwhile the area data are associated with attributes (for example, a text,a picture, or the like) of the image displayed in the area.

In this example, the area data indicates the area by using coordinatevalues in the original paper 40.

IC Chip 3/IC Chip IF 28

FIG. 5 is a diagram for schematically showing a structure of the firstIC chip 3 shown in FIG. 3.

FIG. 6 is a diagram for schematically showing a structure of the IC chipIF 28 shown in FIG. 1 and FIG. 2.

As shown in FIG. 5, the IC chip 3 includes an antenna 300, a clockreproducing circuit 320, a memory circuit 322, a data transmittingcircuit 324, and a power supply circuit 326.

It should also be noted that when it is so guaranteed that the IC chip 3of the original paper 40 passes through an area in close proximity tothe antenna 280, the IC chip 3 having no antenna 300 may be employed.

Also, as shown in FIG. 6, the IC chip IF 28 includes a transmissioncircuit 284, a reception circuit 286, a transmission/reception controlcircuit 282, and a demodulation circuit 288.

In accordance with the below-mentioned operations of the respectiveconstituent components in the IC chip 3 and the IC chip IF 28,information (data), which has been stored in the IC chip 3, is readtherefrom by the IC chip IF 28 in a non-contact manner.

In the IC chip 3 (see FIG. 5), the power supply circuit 326 (FIG. 5)rectifies an electromagnetic wave signal supplied via the antenna 300 soas to supply electric power to the respective constituent components ofthe IC chip 3, while this electric power is required for theseconstituent components.

The clock reproducing circuit 320 reproduces a clock signal from theelectromagnetic wave signal supplied via the antenna 300 from the ICchip IF 28, and then, outputs this reproduced clock signal to the memorycircuit 322 and the data transmitting circuit 324.

The memory circuit 322 outputs data indicating the information (see FIG.4) stored therein to the data transmitting circuit 324 insynchronization with the clock signal input from the clock reproducingcircuit 320.

The data transmitting circuit 324 changes a reflection intensity of anelectromagnetic wave signal supplied from the IC chip IF 28 inaccordance with a value of data input from the memory circuit 322 insynchronization with the clock signal input from the clock reproducingcircuit 320.

As explained above, the data indicating the information, which has beenstored in the memory circuit 322, is transmitted from the IC chip IF 28to the IC chip 3 by changing the intensity of the reflection signal ofthe electromagnetic wave signal, which is transmitted from the IC chipIF 28 to the IC chip 3.

In the IC chip IF 28 (FIG. 6), the transmission/reception controlcircuit 282 controls operations of the respective constituent componentsof the IC chip IF 28.

Also, this transmission/reception control circuit 282 outputs to thecontrol apparatus main body 20 (namely, a first image processing program5, which will be discussed later with reference to FIG. 7), dataindicating the area data, which has been received by the receptioncircuit 286 and then has been demodulated by the demodulation circuit288.

The transmission circuit 284 transmits the electromagnetic wave signalcontaining the clock signal via the antenna 280 to the IC chip 3.

The reception circuit 286 receives a reflection signal, which isreflected from the IC chip 3 side, and then outputs this receivedreflection signal to the demodulation circuit 288.

The demodulation circuit 288 demodulates the data transmitted from theIC chip 3 based upon a change of the reflection signal input from thereception circuit 286, and then outputs the demodulated data to thetransmission/reception control circuit 282.

First Image Processing Program 5

FIG. 7 is a block diagram for schematically showing a structure of afirst image processing program 5, which is executed by the controlapparatus 2 (see FIGS. 1 and 2) so as to realize the image processingmethod according to the invention.

As shown in FIG. 7, the image processing program 5 includes an imagereading section 500, a UI section 510, a data reading section 520, aselecting section 530, a separating process section 540, an imageprocessing section 550, and a printing section 560.

The first image processing program 5 is supplied via, for example, arecording medium 240 (see FIG. 1) to the control apparatus 2, and isloaded to the memory 204 so as to be executed.

In the first image processing program 5, the image reading section 500controls the constituent component of the copy apparatus main body 10such as the scanner 16 (FIG. 2) to read an original image of theoriginal paper 40 (FIG. 3) and to output the read image to the selectingsection 530.

The UI section 510 receives an operation by a user with respect to theUI apparatus 26 (FIGS. 1 and 2), instructs the image reading section 500to read an image, and instructs the data reading section 520 to readdata from the IC chip 3.

It should also be understood that the following case is taken for aspecific example. That is, when the user of the copying apparatus 1inputs data for instructing the UI apparatus 26 to execute an imageprocessing operation and performs a commencement of copying operation,the first image processing program 5 reads an image of the originalpaper 40, executes an image processing operation such as a characterrecognition processing operation with respect to this read image, andthereafter, prints this processed image.

The data reading section 520 controls the IC chip IF 28 to read the areadata and the attribute data (see FIG. 4) from the IC chip 3, and thenoutputs the read area data and the read attribute data to the selectingsection 530.

When the selecting section 530 receives the area data and the attributedata, the selecting section 530 outputs the image input from the imagereading section 500 together with both the area data and the attributedata to the image processing section 550. In other cases, the selectingsection 530 outputs the image input from the image reading section 500to the separating process section 540.

The separating process section 540 executes a separation processingoperation for separating the text image and the picture image from theimage read by the image reading section 500 (this operation will bereferred to as “text/picture separating process operation” hereinafter).

For example, the separating process section 540 executes a clusteringprocess operation for surrounding an area in which an image patternthereof has been recognized as a character, and then, separates theimage of this surrounded area as a text image.

Also, the separating process section 540 executes another clusteringprocess operation for surrounding an area in which an image has beendetected but an image pattern of a character has not been detected, andthen separates the image of this surrounded area as a picture image.

The image processing section 550 contains an OCR section 552 forrecognizing a character from an image, and a γ-correction section 554for performing the γ-correction with respect to a picture.

When the OCR section 552 receives the area data and the attribute datain combination with the image from the selecting section 530, the OCRsection 552 performs a separating process operation for separating atext area based upon the area data and the attribute data, recognizes acharacter from an image of the text area, and then, outputs a font imageof the recognized character to the printing section 560. Furthermore,the image processing section 550 outputs text data of the recognizedcharacter to the recording apparatus 24 to record the text data on therecording apparatus 24.

On the other hand, when the OCR section 552 receives the separated textimage and the separated picture image from the separating processsection 540, the OCR section 552 recognizes a character from theseparated text image and output a font image of the recognized image tothe printing section 560. Further, the OCR section 552 outputs text dataof the recognized character to the recording apparatus 24 to record thetext data on the recording apparatus 24.

The image processing section 550 reproduces the text image of thecharacter recognized by the OCR section 552 by using a font previouslyprepared, and synthesizes the reproduced text image with the pictureimage, and then, outputs the synthesized image to the printing section560.

Also, the γ-correction section 554 performs the γ correction in whichreproducibility of a half tone with respect to a picture image is givenpriority, and then, outputs the γ-corrected picture image to theprinting section 560. Furthermore, the γ-correction section 554 mayexecute a process operation for increasing the contrast of a text imageas a pre-process operation of the character recognizing processoperation performed by the OCR section 552 to further facilitate thecharacter recognizing operation by the OCR section 552.

The printing section 560 controls the print engine 14 (FIG. 2) and thelike to print the image, which is input from the image processingsection 550.

Overall Operation

Next, overall operation of the copying apparatus 1 will be described.

FIG. 8 is a flow chart for describing a first operation (S10) of thecopying apparatus 1 (the first image processing program 5).

As shown in FIG. 8, in a step 100 (S100), a user performs an operationrequired for an image processing operation with respect to the UIapparatus 26 (FIG. 1 and FIG. 2). When the operation for commencing theimage processing operation is carried out with respect to the UIapparatus 26, the image reading section 500 controls the scanner 16 toread an image of the original paper 40.

In a step 102 (S102), the data reading section 520 controls the IC chipIF 28 to read data from the IC chip 3 of the original paper 40, which istransported through the original feeding apparatus 18.

In a step 104 (S104), the selecting section 530 judges as to whether ornot both area data and attribute data are read from the IC chip 3.

When both the area data and the attribute data are read from the IC chip3, the first image processing program 5 is advanced to a processoperation of a step 106 (S106), whereas in other cases, this first imageprocessing program 5 is advanced to a process operation of a step 112(S112).

In the step 106 (S106), the OCR section 552 of the image processingsection 550 separates a text image based upon the area data and theattribute data, and executes the character recognizing process operationfor recognizing a character from the separated text image.

Also, the γ-correction section 554 of the image processing section 550separates a picture image based on both the area data and the attributedata, and executes the γ correction with respect to the separatedpicture image.

Finally, the image processing section 550 synthesizes a font image ofthe recognized character with the picture image, and then outputs thesynthesized picture image to the printing section 560.

In a step 110 (S110), the printing section 560 controls the print engine14 and the like to print the image input from the image processingsection 550.

In the step 112 (S112), the separating process section 540 executes thetext/picture separating operation with respect to the image input fromthe selecting section 530.

In a step 113 (S113), the OCR section 552 of the image processingsection 550 executes the OCR processing operation with respect to theseparated text image to perform the character recognizing processoperation.

The γ-correction section 554 of the image processing section 550performs the γ correction with respect to the separated picture image.Finally, the image processing section 550 synthesizes the font image ofthe character discriminated by the OCR processing operation with theimage of the image area, and then, outputs the synthesized image to theprinting section 560.

The image output to the printing section 560 is printed in accordancewith the process operation of the step 110, which is described above.

As described above, since the copying apparatus 1 recognizes thecharacter constituting the image and reproduces the recognized characterby using the font data, which has been previously prepared for thiscopying apparatus 1, it is possible to prevent deteriorations of theimages, which are caused by repeatedly performing the copying operation.

In this case, the character recognizing process operation requires theheavy processing load. Therefore, preferably, at first the text imagerepresenting a character is separated and then, the characterrecognition process operation is executed with respect to only theseparated text image.

However, this process operation requires analyzing an image so as toseparate the text image and the picture image and therefore is complex.With regard to some images, there is a possibility that text imagecannot be completely separated from picture image.

As a consequence, in accordance with the copying apparatus 1 of thefirst embodiment, since both the area data and the attribute data, whichare read from the IC chip 3, are used, the precision of separating thetext image from the picture image can be increased. In addition, thework load given to this processing operation can be lowered, as comparedwith the work load given to the text/picture separating operation by wayof the image analyzing operation.

Modification

It should be noted that both the area data and the attribute data, whichare stored in the IC chip 3, may be employed as information used toconfirm precision of the text/picture separating process operationexecuted by the separating process section 540.

That is to say, since the results of the text/picture separatingoperations executed by the separating process section 540 are comparedwith the area data and the attribute data, which are read from the ICchip 3, the precision of the text/picture separating operation may beconfirmed.

In this case, both the area data and the attribute data stored in the ICchip 3 need not be related to the entire image.

FIG. 9 is a diagram for showing a structure of a second image processingprogram 52.

As shown in FIG. 9, the second image processing program 52 employs suchan arrangement that the selecting section 530 is deleted from thearrangement of the first image processing program 5, and an areacomparing section 590 is additionally provided.

It should be understood that with regard to the respective structuralelements of the second image processing program 52 similar to those ofthe first image processing program 5, the same reference numerals areallotted.

In the second image processing program 52, the area comparing section590 compares a result of text/picture separating operation by theseparating process section 540 with both area data and attribute data,which are read by the data reading section 520 in order to judge as towhether or not this separation result correspond to the area data andthe attribute data.

In response to a judgment result, the area comparing section 590instructs the image processing section 550 to perform the imageprocessing operation, or instruct to perform the image reading operationand the separating process operation again.

As described above, when the information read from the IC chip 3 isemployed for the confirmation of the text/picture separating processoperation, it is sufficient to store the area data and the attributedata, which are related to a part of an image, into the IC chip 3. As aresult, this method is suitable for a case in which the storage capacityof the IC chip is small.

FIG. 10 is a flow chart for describing a second operation (S12) of thecopying apparatus 1 (second image processing program 52).

It should also be understood that with regard to the process operationsof the second operation shown in FIG. 10 similar to those of the firstoperation shown in FIG. 8, the same reference numerals are allotted.

In the second operation of the copying apparatus 1, after image data hasbeen read in the process operation of the step S100, the separatingprocess section 540 executes the text/picture separating processoperation in the process operation of the step 112 (S112) irrespectiveof a condition as to whether or not both the area data and the attributedata are read from the IC chip 3.

In a process operation of a step 104 (S104), when the second imageprocessing program 52 judges that both the area data and the attributedata can be read from the IC chip 3, the second image processing program52 is advanced to a further process operation of a step S114, whereas inother cases, the second images processing program 52 is advanced toanother process operation of a step S113.

In the process operation of the step 114 (S114), the area comparingsection 590 compares the result of the text/picture separating operationexecuted by the separating process section 540 with both the area dataand the attribute data, which are read from the IC chip 3.

When the area comparing section 590 judges that the text/pictureseparation result is completely coincident with the area data and theattribute data, the second image processing program 52 is advanced tothe process operation of the step S113. When the area comparing section590 judges that the text/picture separation result is not completelycoincident with the area data and the attribute data, but coincidentwith these data at a level higher than, or equal to a predeterminedvalue, the second image processing program 52 is advanced to a processoperation of a step S116. When the area comparing section 590 judgesthat the coincident portion cannot satisfy the predetermined value, thesecond image processing program 52 returns to the process operation ofthe step S100.

In the process operation defined in the step 116 (S116), the imageprocessing section 550 corrects a portion where the text/pictureseparation result is not coincident with the area data and the attributedata by using the area data and the attribute data.

Similar to the case described with reference to FIG. 8, finally, theimage processing section 550 executes an image processing operation inresponse to the respective attributes with respect to the text image andthe picture image, which have been separated from each other, inconjunction with both the OCR section 552 and the γ-correction section554. Then, the printing section 56 prints an image input from the imageprocessing section 550 (steps S113 and S110).

As described above, the second image processing program 52 can evaluatethe result of the text/image separating operation by using the area dataand the attribute data, which are read from the IC chip 3.

Second Embodiment

Next, a second embodiment of the present invention will now beexplained.

In this second embodiment, while an IC chip 3 attached to an originalpaper 40 stores thereinto a portion of an image (text data) indicated onthis original paper 40, the copying apparatus 1 performs an imagecorrection by using this text data in a case that an image read from theoriginal paper 40 is unclear.

It is so assumed that structures and functions of the copying apparatus1 and the original paper 40 are essentially same as those of the firstembodiment.

FIG. 11 is a diagram for showing a modified example of information,which is stored in the IC chip 3. In this modification example, the ICchip 3 attached to the original paper 40 stores thereinto as contentsdata a portion of an image displayed on the original paper 40 inaddition to both area data and attribute data.

When an attribute can be read from the contents data, the IC chip 3 neednot necessarily store the attribute data.

It should be understood that in the following description, it is takenas a specific example that the IC chip 3 stores thereinto text data asthe contents data and the image displayed on the original paper 40 isprocessed by using this text data.

FIG. 12 is a diagram for showing a structure of a third image processingprogram 54.

As shown in FIG. 12, the third image processing program 54 includes anOCR section 552, a content comparing section 580, and a selectingsection 530 between a separating process section 540 and an imageprocessing section 550.

In the third image processing program 54, the OCR section 552 recognizesa character from a text image, which is separated by the separatingprocess section 540, and then outputs this recognized character as textdata to the contents comparing section 580.

The contents comparing section 580 compares the text data of thecharacter recognized by the OCR section 552 with text data read from theIC chip 3.

The selecting section 530 selects either the text data of the characterrecognized by the OCR section 552 or the text data read from the IC chip3 in response to a comparison result made by the contents comparingsection 580 and then, outputs the selected text data to the imageprocessing section 550.

FIG. 13 is a flow chart for describing a third operation (step S14) ofthe copying apparatus 1 (third image processing program 54).

It should also be understood that with regard to the process operationsof the third operation shown in FIG. 13 similar to those of the firstand second operations shown in FIGS. 8 and 10, the same references areallotted.

As shown in FIG. 13, in a process operation of a step 112 (S112), theseparating process section 540 separates a text image from a pictureimage in an image input from an image reading section 500 and then,outputs the text image and the picture image to the selecting section530 and the OCR section 552.

In a process operation of a step 118 (S118), the OCR section 552recognizes a character from the text image input from the separatingprocess section 540 and then, outputs both text data of the recognizedcharacter and a position of the text data to the contents comparingsection 580. Thereafter, the third image processing program 54 isadvanced to a process operation of a step S102. In this processoperation of the step S102, the data reading section 520 reads both areadata and character data from the IC chip 3 and then, outputs both thearea data and the character data to the selecting section 530 and thecontents comparing section 580. The process operation is advanced to aprocess operation of a step S120.

In a step 120 (S120), the contents comparing section 580 compares boththe text data and the position thereof, which are input from the OCRsection 552, with both the character data and the area data, which areinput from the data reading section 520.

When the contents comparing section 580 judges that the text data andthe position thereof are completely coincident with the character dataand the area data, the third image processing program 54 is advanced toa process operation of a step S122.

When the contents comparing section 580 judges that the text data andthe position thereof are not coincident with the character data and thearea data, but are coincident at a level higher than, or equal to apredetermined value, the third image processing program 54 is advancedto a process operation of a step S124. When the contents comparingsection 580 judges that the coincident portion cannot satisfy thepredetermined value, the third image processing program 54 returns tothe process operation of the step S100.

In the step 122 (S122), the selecting section 530 selects the pictureimage input from the separating process section 540 and the text datainput via the contents comparing section 580 from the OCR section 552and then, outputs these selected picture image and text data to theimage processing section 550. The image processing section 550synthesizes the picture image input from the selecting section 520 withthe font image of the text data, and then outputs the synthesized imageto the printing section 560.

On the other hand, in the step 124 (S124), the selecting section 530selects the picture image input from the separating process section 540and the text data input from the data reading section 520 and then,outputs these selected picture image and text data to the imageprocessing section 550. The image processing section 550 synthesizes thepicture image input from the selecting section 530 with the font imageof the text data and then, outputs the synthesized image to the printingsection 560.

Similar to the case of FIG. 8, finally, the printing section 560 printsthe image input from the image processing section 550 (S110).

As described above, the third image processing program 54 can evaluatethe image/picture separation result by using the text data read from theIC chip 3. Also, even when the OCR section 552 cannot sufficientlyrecognize the character, the third image processing program 54 canexecute the image processing operation by using the text data read fromthe IC chip 3.

For instance, in case that text data constructed of a small characterwhose readability is easily deteriorated has been stored in the IC chip3, even when an image quality is lowered by repeatedly performing acopying operation, the copying apparatus 1 can print this smallcharacter under readable condition.

Third Embodiment

Next, a third embodiment of the present invention will now be explained.

In this third embodiment, the copying apparatus 1 determines as towhether or not text data is produced from a read image in response to afact as to whether or not text data can be read from the IC chip 3.

It is so assumed that structures and functions of the copying apparatus1 and the original paper 40 are essentially same as those of the firstembodiment.

FIG. 14 is a diagram for showing a structure of a fourth imageprocessing program 56.

As shown in FIG. 14, the fourth image processing program 56 employs sucha structure that the selecting section 530 of the third image processingprogram 54 shown in FIG. 12 is moved to a position between the imagereading section 500 and the separating process section 540, and thecontents comparing section 580 is deleted from the structure of thethird image processing program 54.

In the fourth image processing program 56, when the data reading section520 reads contents data, the selecting section 530 outputs both an imageinput from the image reading section 500 and the contents data inputfrom the data reading section 520 to the image processing section 550,whereas in other cases, the selecting section 530 outputs the imageinput from the image reading section 500 to the separating processsection 540.

In this case, the contents data corresponds to information (text data)indicating a predetermined image (for example, text image) displayed onan original paper 40.

In the following descriptions, it is taken as a specific example thatthe contents data indicates a preselected text image displayed on theoriginal paper 40.

In other words, in the fourth image processing program 56, when the datareading section 520 reads the contents data is read from the IC chip 3,the image processing section 550 specifies a text image based upon theread contents data, and then synthesizes this specified text image withthe image read from the original paper 40, whereas in other cases, theimage processing section 550 produces text data based upon the imageread from the original paper 40, and then reconstructs an image by usingthis produced text data.

FIG. 15 is a flow chart for describing a fourth operation (step S116) ofthe copying apparatus 1 (fourth image processing program 56). It shouldalso be understood that with regard to the process operations of thefourth operation shown in FIG. 15 similar to the process operations ofthe first to third operations shown in FIGS. 8, 10, and 13, the samereference numerals are allotted.

In the fourth operation of the copying apparatus 1, in a step 126(S126), when contents data is input from the data reading section 520,the selecting section 530 outputs both an image input from the imagereading section 500 and contents data input from the data readingsection 520 to the image processing section 550 and then, the processoperation is advanced to another process operation of a step S130,whereas in other cases, the selecting section 530 outputs the imageinput from the image reading section 500 to the separating processsection 540 and then, the process operation is advanced to anotherprocess operation of a step S112.

In the step 130 (S130), the image processing section 550 specifies atext image (font, size of character, color of character, position to bedisplayed etc.) based upon the contents data. Subsequently, the imageprocessing section 550 synthesizes the specified text image with theimage input from the selecting section 530 (S128).

On the other hand, in the step 112 (S112), the separating unit 540separates the image input from the selecting section 530 into acharacter and a picture and then, outputs these separated character andpicture to the image processing section 550 and the OCR section 552.

In the step 118 (S118), the OCR section 552 recognizes a character fromthe text image input from the separating process section 540 and then,outputs the text data of the recognized character to the imageprocessing apparatus 550 and the recording apparatus 24.

Subsequently, the image processing section 550 synthesizes the text dataof the recognized character with the picture image separated by theseparating process section 540 (S128).

It should also be noted that the text data recorded on the recordingapparatus 24 may be displayed on, for example, the UI apparatus 26 so asto be utilized in confirming/editing operations of the character contentby the user.

Finally, similar to the case explained in FIG. 8, the printing section560 prints the image input from the image processing section 550 (S110).

As described above, in the fourth image processing program 56, in such acase that the contents data is read from the IC chip 3, a part of theimage, which is to be printed, is formed based upon the read contentsdata, whereas in other cases, the text data can be produced based uponsuch a text image which has been separated into the character and theimage.

The produced text data is recorded on the recording apparatus 24 and thelike. When the original paper 40 is again processed in the copyingapparatus 1, this recorded text data may be read from the recordingapparatus 24 so as to be utilized. When the IC chip 3 is in a datawritable condition, the fourth image processing program 56 may recordthe produced text data in the IC chip 3.

As previously explained, in accordance with the image processing systemand the image processing method of the present invention, the processoperations can be carried out which are adapted with respect to the textimage and the picture image contained in the image, while utilizing sucha semiconductor chip from which the data stored thereinto may be read inthe non-contact manner.

1. A method comprising using a computer to perform the steps of: readingarea data and attribute data from a non-contact memory attached to anoriginal document, the area data indicating an area of an image displaymember in which at least one sort of image is displayed, and theattribute data indicating attributes of the at least one sort of image;supplying the area data and the attribute data to an external of theimage display member; reading the displayed image; separating the atleast one sort of image from the read displayed image on the basis ofthe supplied area data; and performing an image processing with respectto the separated at least one sort of image in response to theattributes of the at least one sort of image on the basis of thesupplied attribute data.
 2. A non-transitory computer readable storagemedium having stored therein a computer program for causing a computerof an image process apparatus to execute a process, comprising: readingarea data and attribute data from a non-contact memory attached to anoriginal document, the area data indicating an area of an image displaymember in which at least one sort of image is displayed, and theattribute data indicating attributes of the at least one sort of image;supplying the area data and the attribute data to an external of theimage display member; reading an image displayed on the image displaymember; separating the at least one sort of image from the readdisplayed image on the basis of the supplied area data; and performingan image processing with respect to the separated at least one sort ofimage in response to the attribute of the at least one sort of image onthe basis of the supplied attribute data.